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Abstract 

This report describes preliminary work about intrinsic numerical 
integrators evolving on groups. Fix a finite dimensional Lie group G, 
let g denote its Lie algebra, and let Y^, . . Ys denote a basis of g 
■ We give a class of numerical algorithms to approximate solutions to 
differential equations evolving on G of the form: 

*(0 = ^(*(0). *(0) = p€G, 

m 

where 

N 

F = Yj a,lY ^ a>i ^ C°°(G). 

#i=l 

The algorithm depends upon constants c* and , for i = 1, . . . , k and 
j < i. The algorithm has the property that if the algorithm starts 
on the group, then it remains on the group. It also has the property 
that if G is the abelian group R^, then the algorithm becomes the 
classical Runge-Kutta algorithm. We use the Cayley algebra generated 
by labeled, ordered trees to generate the equations that the coefficients 
Cj and Cij must satisfy in order for the algorithm to yield an rth order 
numerical integrator and to analyze the resulting algorithms. 

*This research was supported by the NSF and EPRI. 

^his research is supported in part by NASA grant NAG2-513 and NSF Grant DMS- 
8904740. 

*This research is supported by NSF Grant DMS-8904740. 
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1 Introduction 


Fix a finite dimensional Lie group G, let g denote its Lie algebra, and let 
yi, . . Y n denote a basis of g . We give a class of numerical algorithms to 
approximate solutions to differential equations evolving on G of the form: 

i(t) = F(x(t)), z(0) = p € G, 

where 

N 

F=J2 € C°°(G). 

M =1 

The algorithm depends upon constants c t * and c tJ , for i = 1, . . . , Jb and j < i. 
The algorithm has the property that if the algorithm starts on the group, 
then it remains on the group. It also has the property that if G is the 
abelian group R^, then the algorithm becomes the classical Runge-Kutta 
algorithm. Our analysis requires the Cayley algebra generated by labeled, 
ordered trees, introduced in [10], [11] and [6]. We use the Cayley algebra of 
trees to generate the equations that the coefficients c t and c,j must satisfy 
in order for the algorithm to yield an rth order numerical integrator and to 
analyze the resulting algorithms. 

This is a preliminary report. A final report containing complete proofs, 
examples, and a further analysis of the algorithms is in preparation. 

2 Families of trees 

The relation between trees and Taylor’s theorem goes back as least as far as 
Cayley [3] and [4]. Important use of this relation has been made by Butcher 
in his work on high order Runge-Kutta algorithms [1] and [2]. In this section 
and the next, we follow the treatment in [10] and [11]. 

By a tree we mean a rooted finite tree. If {Fi, Fm } is a set of 
symbols, we will say a tree is labeled with {F\ , . . . , Fm} if every node of the 
tree other than the root ha s an element of {Fi, . . . , Fm } assigned to it. We 
denote the set of all trees labeled with {F\ } . . . , Fm} by £T(Fi, . . . , Fm) ■ 
Let k{CT(F\ F m)} denote the vector space over k with basis £T(Fi, 

. . . , Fm ) * We show that this vector space is a graded connected algebra. 

We define the multiplication in k{CT(F\ y Fm)} as follows. Since 
the set of labeled trees form a basis for k{CT{F\ y . . . , Fm)} , it is sufficient 
to describe the product of two labeled trees. Suppose t\ and ti are two 
labeled trees. Let $i y . . . , s r be the children of the root of t\. If i*i has n + 1 
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nodes (counting the root), there are (n + l) r ways to attach the r subtrees 
of t\ which have s\, . . . , s r as roots to the labeled tree 1 2 by making each s, 
the child of some node of f 2 , keeping the original labels. The product < 1*2 is 
defined to be the sum of these (n + l) r labeled trees. It can be shown that 
this product is associative, and that the tree consisting only of the root is a 
multiplicative identity; see [5]. 

We can define a grading on Jk{£T(Fi , . . . , F*/)} by letting k{CT n {F \ , 
. F m )} be the subspace of k{CT(F\ 1 Fm)} spanned by the trees 
with n -f 1 nodes. The following theorem is proved in [9]. 

Theorem 2.1 k{CT(F\ , ..., Fm)} is a graded connected algebra. 

If {Fi, ..., Fm] is a set of symbols, then the free associative algebra 
k<F\ } ..., Fm> is a graded connected algebra, and there is an algebra 
homomorphism 


<t> : fc<F lf . . . , F m > - k{CT{F x Fm)} 

The map <f> sends F t to the labeled tree with two nodes: the root, and a 
child of the root labeled with F,; it is* then extended to all of Jb<Fi, . . . , 
Fm> by using the fact that it is an algebra homomorphism. 

We say that a rooted finite tree is ordered in case there is a partial 
ordering on the nodes such that the children of each node are non-decreasing 
with respect to the ordering. We say such a tree is labeled with {Fi, . .., 
Fm} in case every element, except the root, has an element of {Fi, . . . , Fm} 
assigned to it. Let k{CQT{F\, . Fm)} denote the vector space over k 
whose basis consists of labeled ordered trees. It turns out that k{COT{Fi } 
. . . , Fm)} is also a graded connected algebra using the same multiplication 
defined above. See [9] for a proof of the following theorem. 

We say that a rooted finite tree is heap-ordered in case there is a total 
ordering on all nodes in the tree such that each node procedes all of its 
children in the ordering. We define k{CHOT{F \ , . . . , Fm)} as above to be 
the vector space over k whose basis consists of heap-ordered trees labeled 
with {Fi , . . . , Fm }• In [9] we show that k{CHOT (Fi, . . . , Fm)} is also a 
graded connected algebra [9] and satisfies: 

Theorem 2.2 The map 

d> : k<F l} . . . , F m > - k{CHOT{F u . . . , F M )} 


is injective. 
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Fix N derivations Vi , . . . , Yjv of R and consider M other derivations of 
R of the form 

N 

Fi = £ » = 1, . . . , M. (1) 

M=1 

Let End (R) denote the endormorphisms of the ring R . Using the data (1), 
we now define a map 

4>:k{CT(F u ...,F M )}->End(R) 

in the following steps. 

Step 1. Given a labeled tree t £ CT m (F\ ) } Fm) } assign the root the 
number 0 and assign the remaining nodes the numbers 1, . . . , m. From now 
on we identify the node with the number assigned to it. Let j £ nodes t , 
and suppose that / 7 are the children of j and that j is labeled with 

F yr Fix with 

1 < < N 

and define 

R(j] ■ ■ ■ , w) = Yu, • • ■ 

if j is not the root 
— Y . . . Y 

if j is the root . 

We abbreviate this to R(j). Observe that R(j) £ R for j > 0. 

Step 2. Define 

N 

m= L R(m)--R(l)R(0). 

Step 3. Extend ip to all k{CT(F \ , . . . , Fm)} by ifc-linearity. 

Remark 2.1 In exactly the same way, we define a map 

tp -.k{CT(F u .... F M )} ^End(R), 
by ignoring the ordering of the nodes. 
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Remark 2.2 Let H denote one of the algebras of labeled trees above, pos- 
sibly with additional structure such as an ordering or heap ordering. It is 
easy to check that the t/> map makes R into a left //-module. 

Let x denote the map 

k<F \ } . . . , Fm> — ► End (R) 

defined by using the substitution (1) and simplifying to obtain an endor- 
morphim of R . 

Lemma 2.1 (i) The map is an algebra homomorphism 

(ii) and \ ° 0« 

Proof: The proof of (i) is a straightforward verification and is contained 
in [8]. Since \ and 0 ° <t> agree on the generating set E \ , . . . , Em, part (ii) 
follows from part (i). 

In the later sections, we will also require two other products defined on 
families of trees. Given t\,t 2 € CT(F \ , Fm), define the meld product 
t 2 O *i to be the labeled tree obtained. by identifying the roots of the two 
trees. The meld product is then extended to all of k{CT{F\ ) . . . , F\f)} by 
linearity. Given a derivation F £ Der(/2), let <2 be the tree 4>{F) and let 
fi G CT(F\, . . . , Fjvf). Recall t 2 is a tree consisting of a root and a node 
laveled F . We define the composition product <2 0 to be the tree formed 
by attaching the subtrees whose roots are the children of the root of fi to 
the node labeled F of the tree * 2 - 

3 Trees and Taylor Series 

Fix a Lie group G of dimension N } with Lie algebra g> and let R denote a 
ring of infinitely differentiable functions on G. We let exp : g — * G denote 
the exponential map. 

Fix a basis of the Lie algebra g consisting of left invariant vector fields 
Vi, • • . , Yjg. We will need a map 

N 

t : R N — >R®9, (ai, . . . ,aw) ^ 

At=l 


and its inverse, which we denote b. We usually write these maps as super- 
scripts, as in (ai, . . . , ayv) a . 
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We are interested in derivations F of the form 


N 

F = !>'%> = 

and the corresponding differential equation 

i(f) = F(*(0), r(0)=p€G. (2) 

Let exp (tF)(x) denote the resulting of flowing for time t along the trajectory 
of (2) through the initial point p £ G. We require two lemmas concerned 
with Taylor series expansion of a solution of (2). These lemmas will use the 
maps <f) and ip defined in the previous section. 

If or is a tree, define the exponeniial and Meld-exponential of a tree by 
the formal power series 

t 2 t 3 

exp(fa) = 1 + ta + —a 2 + —a 3 + • • • 
i 2 t 3 

Mexp(fa) = 1 + fa + —a 0 a + —a © a © ar + • • • . 

Lemma 3.1 Assume f £ R and F G Der(/2). Then 

1 . 

( F k f)(x ) = ^p:f(exp(tF)x) | t=0 . 

2. If f is analytic near x, then for sufficiently small t } 

oo ,k 

f(exp{tF)x) = ^ /(*; F k )— , 
fc = 0 

where f(x\F k ) is defined to be (F k f)(x). 

3 . If f is analytic near x , then for sufficiently small t, 

f{exp(tF)x) = ip(exp(t<j>(F)))f\ x , 


where a = 4>{F). 

Proof. Assertions (1) and (2) can be found in [12]. Since <f> is an algebra 
homomorphism, <fi(F k ) = a k . Assertion (3) then follows immediately from 
Assertion (2). ■ 
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Lemma 3.2 Assume f £ R and F £ Der(/Z) is left-invariant. Let a = 
<f>(F). Then 

1. 

f(exp(tF)x) = f{x) + tDf(x) ■ F{x) + t —D 2 f(x)(F(z), F(x)) + • • • 

2 . 

f(exp{tF)x) = V>(Mexp(ia)) • f\ x . 

3. If G £ Der(R), 

#(l>(G ! )(exp(<F)x)) = tp((3 o Mexp(fa)), 
where ft = <fi(G). 

Proof. Assertion (1) is simply Taylor’s theorem. Assertion (2) follows from 
Assertion (1) and the definition of the map, since left-invariant vector 
fields have “constant coefficients” with respect to the basis Y Assertion (3) 
follows from Assertion (2) and the definition of the flat and sharp maps. 


4 The algorithm 

We are interested in numerical algorithms of the Runge-Kutta type to ap- 
proximate solutions of 

x(t) = F(x(t)), x(0) = p£G, 

where F £ Der(ft). The algorithm depends upon constants C{ and c,j, for 
: = 1, . . . , k and j < i. For fixed constants, define the following elements of 
the Lie algebra g 

N 

F\ = £ € 9 

M=1 

N 

F 2 = £ a^(exp(hc 2 iFi) • i/ 0 )T m £ g 

m=i 

N 

Fa = E ^(exp(hc 32 F 2 ) ■ exp(hc 3l Fi) ■ u Q £ g 

M=1 
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These arise by “freezing the coefficients” of F at various points along the 
flow of F. 

Algorthm 1. Version 1. Let xo — p and put 

x n+1 = exphc k F k • • -exphciFiXn, 


for n > 0. 

Version 2. Let xo — p and put 

i„ + i = exp {hc k F k H h exp hc x F\ ) x n , 

for n > 0. 

5 Necessary conditions 

We prepare with two lemmas. 

Lemma 5.1 Let f G R and 

Xi = m) € k{CT(Fi, .... F M )}[[h]]. 

Then 

Am = mm/) 

Fiif) = 4>{4>{F) o Mexp(/ic 2 iXi))(/) 

F3(f) = rp{<j>{F)oMexp(hc3iXiQMexp(hc32X2){f) 


Here xp is essentially the t p map followed by “freezing the coefficients” at 
uq. More precisely, 

i:k{CT(F u ...,F M )}^End(R). 

We do this in several steps. 

Step 1 . Given a labeled tree t G CT m (F\, . Fm), assign the root the 
number 0 and assign the remaining nodes the numbers 1, . . . , m. From now 
on we identify the node with the number assigned to it. Let j G nodes t , 
and suppose that are the children of j and that j is labeled with 

F 1} . Fix /i/, . . . , m* with 

1 < Ji/i N 
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and define 


- Y» v (^o) 
if j is not the root 
— y . . . y 

if j is the root . 

We abbreviate this to R(j). 

Step 2. Define 

N 

m= E *("»)• -.fl(l)*(0). 

Step 3. Extend xp to all k{CT{F \ , . . . , Fa/)} by ifc-linearity. 

It is useful to have an intrinsic characterization of the elements X{ £ 
k{CT(F\ , Fa/)} [[/»]]• Order the labels F\ } . . Fa/ according to their 

subscripts: F\ < • • • < Fa/. Let C?T(Fx , Fa/)} denote those 

elements of ifc{£T(Fi, . . . , Fa/)} satisfying 

1. The nodes are heap ordered with respect to the labels F\ ) . . . , Fa/; in 
other words, the label of a child of a node is (strictly) smaller than the 
label of the node itself. 

2. The children of a node are ordered with respect to the labels F\ y . . . , 
Fa/; in other words, the labels of the children of a node are nonde- 
creasing. 

Using ordered, heap ordered trees it is easy to keep track of the constants 
C{ and Cjj that arise in Taylor series computations. To do this we define a 
map analogous to the rp map. 

Define 

p : k{COnOT(F x , . . . , Fa/)} — End (R) 

as follows 

Step 1. Given a labeled tree t £ COHQT(F \ , . . . , Fa/), with m + 1 nodes, 
assign the root the number 0 and assign the remaining nodes the numbers 
1, . . . , m. From now on we identify the node with the number assigned to 
it. Fix a node j of t and let /' denote its children. Let F 7; denote the 
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label of node j. Let p, denote the number of children of j labeled with the 
label F t , for i = 1, . . . , M. Let |p| denote pi + • • • + pm • Fix p/, . . . , pj> with 

1 < p/, . . . ,p// < AT 

and define 

R{.j\nu-,nv) = 

We abbreviate this to 
Step 2. Define 

N 

p(t)= £ ft(m)-..ft(l)ft(0). 

Step 3. Extend p to all C?T(Fi , . . . , Fm)} by fc-linearity. 

Lemma 5.2 Let X{ — 4>{F{) and f £ R. Then 

*.(/) = X>(*)(/), 

where the sum is over all trees t £ CO'HOT(F\, . . , Fm) satisfying (i) t 
consists of i + 1 or fewer nodes; ( ii ) the root of the tree has a single child 
labeled F, . 


hM 


c jl ' ' ‘ c jV 


Y*r Y^]{u 0 ) 


PV ’PM' 
if j is not the root 

Y . . . Y 
1 1 /v 

if j is the root . 


It is now straigtforward to derive the following necessary condition for a 
fcth order Runge-Kutta algorithm on a group. 


Theorem 5.1 A necessary condition for a Runge-Kutta method of order k 
on a group is that for each rooted , ordered tree t consisting of k + 1 or fewer 
nodes 




i 

(#(nodes ( <)) - 1)!’ 


where the sum is over allt £COHOT{F \ , . Fm) having the same topol- 
ogy as t. 
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